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ABSTRACT 


In this report, some measures of eigenvalue and eigenvector sensitivity applicable to 
both continuous and discrete linear systems are developed and investigated. An infinite 
series representation is developed for the eigenvalues and eigenvectors of a system. The 
coefficients of the series are coupled, but can be obtained recursively using a nonlinear 
coupled vector difference equation. 

A new sensitivity measure is developed by considering the effects of unmodeled dy- 
namics. It is shown that the sensitivity is high when any unmodeled eigenvalue is near 
a modeled eigenvalue. Using a simple example where the sensor dynamics have been 
neglected, it is shown that high feedback gains produce high eigenvalue/eigenvector sensi- 
tivity. The smallest singular value of the return difference is shown not to reflect eigenvalue 
sensitivity since it increases with the feedback gains. 

Using an upper bound obtained from the infinite series, a procedure to evaluate 
whether the sensitivity to parameter variations is within given acceptable bounds is devel- 
oped and demonstrated by an example. 
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I. INTRODUCTION 


Most complex systems of interest contain uncertainties in at least some parameters. 
Beyond this aspect, system parameters vary over the range of operating points in which the 
system is supposed to perform its basic objective. Finally, the system design model usually 
neglects some dynamic effects in order to simplify the design process and to accommodate 
nonlinear effects and avoid determining some subsystem characteristics. Therefore, in 
the design of the feedback control law, one of the most important considerations is the 
closed-loop system’s robustness. 

In this study, by system robustness we shall mean that the basic system properties or 
characteristics are sufficiently insensitive to the various system parameter variations and 
modeling errors to perform the basic system objective. The feedback controller modifies the 
system matrix (A) to achieve a variety of system characteristics such as transient response, 
sensor and plant noise suppression, feedforward bandwidth, stability, etc. However, it is 
necessary that these characteristics be performed in an acceptable manner despite any 
unmodeled dynamics and other system parameter variations. 

To achieve these closed-loop system characteristics, the designer of the feedback con- 
trol law has a variety of methods at his disposal ranging from stochastic optimization 
methods such as full-state feedback LQG, output feedback, pole placement, classical fre- 
quency techniques, etc. The use of the stochastic output feedback and feedforward design 
techniques developed by the author [l] - [5] have proved to be suitable in many cases. 

When a feedback design is being considered, it is necessary to evaluate the robust- 
ness of the resulting closed-loop system. Since the feedback design produces a closed-loop 
system matrix, and this matrix is completely determined by its eigenvalues and eigenvec- 
tors, it seems reasonable to assume that the desired system characteristics are implicitly 
contained in the closed-loop eigenstructure. Therefore, to evaluate the sensitivity of the 
system characteristics designed, it may be sufficient to consider the sensitivity of the sys- 
tem’s eigenvalues and eigenvectors. In this investigation, we will develop some measures 


of eigenvalue and eigenvector sensitivity to evaluate a given feedback design from the 
standpoint of robustness and try to establish some trends. 

Eigenvalue sensitivity has received some attention in the literature [6] - [18]. The 
majority of the work on eigenstructure sensitivity deals with the l at derivative of the 
eigenvalues and sometimes the eigenvectors with respect to a parameter. In some cases, 
the 1 st derivative of the state trajectory is investigated. In other cases, the sensitivity of 
the type-1 property is studied. 

More recently, a frequency domain approach to robustness has been introduced [19] 
- [24]. This approach stems from a desire to extend classical SISO sensitivity measures 
to MIMO systems. The measure of robustness used is the smallest singular value of the 
return difference matrix as a function of frequency. 

In this report, measures of system sensitivity based on the closed-loop eigenvalues and 
eigenvectors are developed. A new measure of sensitivity is introduced by investigating the 
effect of unmodeled dynamics. This measure is applied to an example where the dynamics 
of a sensor are neglected in the model, as is often the case. It is shown that as the system 
gains are increased, the actual system eigenvalue sensitivity increases and may even lead 
to instability. Therefore, this measure of sensitivity requires that the feedback gains be 
maintained at lower levels if possible. 

The fact that high feedback gains cause significant robustness problems, is usually 
first encountered when a high-gain design based on a linear model is simulated on a noisy 
and fully nonlinear simulation. In most complex physical systems, unmodeled dynamics 
occur due to nonlinear effects and the complexity which would be required to model all 
structural modes, electronic harmonics, etc. Thus the unmodeled dynamics are essentially 
a fact of life for the control designer. 

The sensitivity to unmodeled dynamics places a limit to how high the loop gains can 
realistically be set. 

The smallest singular value of the return difference, however, generally increases with 
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increasing feedback gains. This implies that the higher the feedback gains, the higher the 
system robustness! This trend of the singular value based sensitivity approach is puzzling 
and leads to the conclusion that the smallest singular value of the return difference is more 
a measure of stability margin and plant noise suppression properties rather than system 
sensitivity or robustness. 

Then, infinite series representations of the system eigenvalues and eigenvectors are 
developed. It is shown that the coefficients of the power series for the eigenvalues and 
eigenvectors can be recursively obtained. From this series representation, an upper bound 
on the variation in the eigenvalues and eigenvectors is obtained and applied to evaluate 
the sensitivity of an example. 
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II. AN INFINITE SERIES REPRESENTATION OF 
EIGENVALUES AND EIGENVECTORS 


Some of the most important characteristics of a linear system, whether continuous or 
digital, are contained in the eigenvalues and eigenvectors of that system. For example, the 
stability of the system is completely determined by the location of the eigenvalues; similarly, 
the damping ratios, the zeroes and poles, the modal behavior, etc. are determined by the 
system eigenvalues and eigenvectors. 

The linear systems which will be considered in this study are of the form 

x = A x + B u , (1) 

for continuous time systems, and 

Xk+i = 4 Xk + T u k , ( 2 ) 

for discrete time systems. In both the continuous and discrete system cases, the state x 
is considered to be a n-vector and the control u a r-vector. Thus, the system matrices A 
and <f> both have the dimensions n x n, while B and T are dimensioned n x r. 

The system eigenvalues and eigenvectors are defined as those of the matrices A or 
<f> according to whether the continuous system (1) or the discrete system (2) is under 
investigation. Thus, in both cases, we are interested in the eigenvalues and eigenvectors 
of a square matrix: In the following, we will derive an infinite series for the eigenvalues of 
the square matrix A\ the results, of course, are equally applicable to the discrete system 
matrix <f>. 

In most systems of interest, the system matrix, A, varies with the operating point; so 
that the system matrix A(p) is a function of some parameter, say p. In this study, we are 
interested in determining the variation in the eigenvalues and eigenvectors of the matrix 
A[p) as the parameter p varies. 
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A. Power Series for Eigenvalues and Eigenvectors 


Now suppose that we have an infinite series representation of the system matrix A(p) 

A (p) = Y, A *P k ’ ( 3 ) 

k = 0 

Also suppose that A,(p) and x,(p) form an eigenvalue-eigenvector pair for A(p); i.e., 


A(p) Xi(p) = A t (p) x i(p) , 1 < * < n (4) 

Note that p = 0 corresponds to the case where A(0) = A 0 is the system matrix for 
the reference operating point. Now, suppose that the eigenvalue A,(p) and the eigenvector 
Xi (p) have infinite series representations of the form 


OO 


A»(p) = Y Xik pk » 1 < * < n » 

k=0 

(5) 

OO 

x dp ) = Y x<k pk ’ i < * < « , 

k= 0 

(6) 


Let us denote the smallest of the radii of convergence for the power series in (3), (5) 
and (6) by d. So that all three power series converge absolutely within [— d, d\. Unless 
stated otherwise, we will consider p to belong to the interval [ — d , <£]. 

In order to understand and evaluate the changes in the system matrix A(p) as the 
parameter, p, varies within [— d, d], it is of interest to find expressions for the coefficients 
of the infinite series, i.e., A lfc and x ik . Rewriting (4), we obtain 


Y A k p k Y xi J p* = Y Xik pk Y Xi i p* 

L k = o '■)= o *-fc=o J L y=o 

Using well-known properties of power series [l], we obtain that within [— d, <£], 


(7) 


k=o L j = o 


y! Y, A j x ik—j p k — Ys Ys Xik ~i 


k= o L j=0 


1 < t < n (8) 
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A: 

^(A,y I -4y ) %tk—j = 0 , k >0 , 1 ^ i ^ n (9) 

y=o 

From (9), it is seen that the coefficients of the power series satisfy a homogeneous 
difference equation of non-finite order. The case of k = 0, can be seen to be a restatement 
of (4) when p — 0; i.e., 


(A, 0 I — A 0 ) X{ 0 = 0 , 1 < i < n , (10) 

which states that the coefficients A t0 and x,- 0 form an eigenvalue-eigenvector pair for the 
matrix >1(0) = A 0 . This is already clear from (5) and (6); however, the higher order coef- 
ficients are the ones which contain information about the variations in the eigenstructure 
of A(p) as p varies within \—d, d]. For example, when k = 1 , we have 


(A to I A 0 ) xn — ( A\ A,i J) Xi 0 (ll) 

Since (11) contains n+1 scalar unknowns (i.e., x,i and A,i), but only contains n equa- 
tions, it may appear that a solution cannot be obtained. However, since the eigenvector, 
x t (p), is only determined up to a constant factor, the coefficients x,-y maintain one degree 
of freedom. On the other hand, the coefficients, A,*, are unique and can be determined 
from the set of equations in (9). 

To simplify the derivation, consider the case where .4(0) has distinct eigenvalues. 
Minor variations are required to treat the case where .4(0) has eigenvalues of multiplicity 
greater than 1. Let e,- be the i th column of the n x n identity matrix, and let X 0 be the 
non-singular matrix whose columns are the eigenvectors of >1(0); i.e., 

X 0 ti = Xi 0 , 1 < * < n . (12) 


It follows that 
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A 0 = X 0 A 0 X~ l 


(13) 


where A 0 is a diagonal matrix containing the eigenvalues, {A, 0 , 1 < i < n}, of .4(0). Let 
Cik be defined by 


Xq Cik — k > Cik — X 0 X ik , k > 0 , 1 ^ U • (14) 

Now (9) can be restated as 
k 

5^(A<y I Ay) Cik—j = 0 , k >0 , 1 ^ i < n , (15) 

3-0 

Ay = X~ 1 -Ay X 0 , j > 0 , (16) 

where Ay is not necessarily diagonal when j > 0, but can be easily computed from (16). 

To show that we can recursively compute Xik and c^, assume that {A,y,c,y,0 < j < 
k — 1} are known and note that 

Ci 0 = Ci , 1 < t < n , (17) 

ej (Ai 0 I — A 0 ) Cik = 0 , 1 < i < n , k > 0 (18) 

where (17) follows from (14); now pre-multiplying (15) by cj and using (17) and (18), it 
is seen that* 


k— X 

Xik = ej A fc Cf + Yl ef (Ay - A,y I) c ik - y , k > 0 (19) 

y=i 


^ Jt • 

*Throughout this work, we use the convention that J2j=i a j — whenever k < i. 
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k k— 1 

At k ~ ^ ^ e t Ay Cik—j ^ ^ (®» C\k—j ) j /c ^ 1 . (20) 

y=i y=i 

Note that A,* does not depend on c,* as a result of (18) and can be computed using 
either of the equivalent expressions in (19) or (20). Now, to obtain the expression for c,-*, 
rewrite (15) in the form 

k 

(A*o I h-o) Cik = ^ ] (Ay A,y /) Cik—j 1 k > 1 (21) 

y=i 

As noted in (18), the diagonal matrix (A t0 I— A 0 ) has a zero as its diagonal element; 
so that the left-hand-side (LHS) of (21) is independent of the t th element of c,-*; i.e., ef c t -*. 
Therefore, the element of c,* cannot be obtained from (21). However, the remaining 
elements of c,* can, in fact, be obtained from (21) since all the remaining elements on the 
diagonal of (A , 0 1 — A 0 ) are non-zero. 

Let (A i 0 I — A 0 )# represent the following pseudo-inverse 

k 

(A to I — A 0 )^ = ^ ^ (A * o Ay 0 ) * Cj tj , 1 < t < n . (22) 

y=i.y#» 

It follows that 


K 

&ik = (^t'o I ~ A o)# ^ ^ (Ay — A,y J) C,'^_y + e t - , fc > 1 , 1 ^ l W ) (23) 

3 = 1 

where c,-*,- is the component of c;* which is not determined from (21). 

Since A,k is independent of c,*, it can be computed first and substituted into (23) 
to obtain the components of e<*, except for the i th component which will be shown to be 
arbitrary, presently. It follows by induction that all the coefficients A,* and c,-* can be 
obtained recursively using (20) and (23). 

Alternatively, suppose that we have the sequences {A,-*, c t -fc, k > 0} which satisfy 
(19) and (23), where c,-*,- is an arbitrary complex number for each k, and where c t0 = e,. 


8 


Pre-multiplying (23) by (A to I — A c ) and using (19) for the i th row results in (21) which 
implies (19). If the power series (5) and (6) converge for the above sequences, it follows 
that A,(p) and x,(p) form an eigenvalue-eigenvector pair for the matrix A(p) within the 
mutual convergence region of (3), (5) and (6). 

From the preceding, it is clear that the i th component of c,* can be selected arbitrarily 
for each k. As mentioned earlier, since the eigenvectors of a matrix are only determined up 
to scalar factor, it is not surprising that the coefficients of the expansion for the eigenvectors 
have a degree of freedom. One approach is to select c.-^i so as to simplify the formulae and 
computation of A,* and c.t-. An obvious choice would be 

C{ki — — 0 , k > 1 , l<t<w . (24) 

This selection would result in selecting the eigenvector x,(p) which satisfies 

ej X~ l x,(p) = 1 , pe[—d, d ] , 1 <t <n . (25) 

Thus, unless the eigenvector x,(p) is orthogonal to its corresponding row-eigenvector at 
p = 0, i.e., ef X' 1 , the selection (24) is valid. 

With the selection of (24), or alternatively (25), the coefficients for the infinite series 
of the eigenvalues and eigenvectors become 

k 

A tfc ~ ^ ^ c,- Ay , /c^l , 1 < * < n. , (2b) 

3 = 1 

k 

Cik = (A to / - A o) # Y, ( A > - A ‘f c ik-3 , k > 1 , 1 < *• < n . (27) 

3 = 1 

C{o = c* , 5, A o = Aio , 1^1^^ (28) 

Finally, it is important to note that while the eigenvectors and their coefficients are not 
unique, the eigenvalues and their coefficients are unique. In other words, no matter what 
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selection of eigenvectors is made, the numerical value obtained for A,-* will be the same. 
This is very significant as it implies that the sensitivity of the eigenvalues of a linear system 
is independent of the particular representation of the system, which is a desirable property; 
i.e., sensitivity is a property of the system itself rather than its particular representation. 

B. Expressions for Some Coefficients 

Thus, we have shown that when the system matrix A(p ) can be expressed in the 
form of (3), as the parameter, p, varies, the system eigenvalues and eigenvectors also vary 
according to (5) and (6), where the coefficients axe given by (26), (27) and (28). The 
change is the eigenvalues A , (p) as p varies within the convergence region can be evaluated 
by analyzing the coefficients, A,*. Thus, using (26) and (27), 

A,i = ef Ai c io = ef Ai e< , 1 < t < n (29) 

A.-! = ef X~ l A x X 0 ti , 1 < t < n (30) 

It is interesting to note that A,i depends only on A\ but not on higher order terms 
such as ^4.2, Az , etc. Having computed A,i, we can now obtain Cii and Ai 2 . 

ca = (A,-, I - A,)# (A : - A tl I) a , 1 < i < n . (31) 

Using (31) in (19), we obtain 

A t2 = ef A 2 e, + ef(Ai - A tl I) (X io I- A,) # (Aj - A tl I) e { , 1 < i < n (32) 

Ci2 = (Ai, / - A,)# [(Ai - Ai! I) (Ai, I - A,)# (Ai - A,i I) 

+ (A 2 - Art /)] Ci , 1 < *■ < n . (33) 
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It can be shown that A,i and A, 2 remain unchanged if the eigenvectors are selected 
differently than (27), by using the more general expressions in (23) and (19). The resulting 
expressions for A,i and A,- 2 can be reduced to (29) and (32) after some manipulation which 
will not be included here. 

From the preceding, it is clear that the coefficients for the power series for the system 
eigenvalues and eigenvectors can be easily computed using the recursive algorithms derived. 

C. Upper Bounds on Eigenvalue Variations 

The variations in the eigenvalues A, (p) as p varies can be closely approximated in the 
vicinity of p = 0 by using the first one or two terms of the power series developed and 
neglecting the remainder. While this provides the more significant information and will be 
discussed later in more detail, it is also of interest to have a upper bound on the eigenvalue 
variations, in particular, when large variations in the parameter, p, are being considered. 
Usually, the large variations are of interest in order to establish characteristics such as the 
stability margin rather than the tracking control performance characteristics. 

In the following, we will develop an upper bound on the change in each eigenvalue 
using the infinite series obtained for the eigenvalues and eigenvectors. To simplify the 
derivation, we will consider the case 

A(p) = A 0 + A lP = X 0 (A 0 + Ax p) X~ x , (34) 

A k = A fc = 0 , k > 2 . (35) 

Rewriting (26) and (27) for each t, we have 

A a = ef Ai Cik-i , k> 1 (36) 
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k > 1 


(37) 


c ik — (A»'o I A 0 )^ [Ai Cik—l ^ ] A,y Ctfc— j] 

y=i 

From (36) and (37), it follows that 


|Aifc| ^ A-i Cik—l 


k > 1 


(38) 




A A,- 


IIA.II Ife-.ll + E |A (J | ||c,- fc _j| 

y=i 


where I* || denotes a compatible matrix and vector norm and, 


k > 1 , (39) 


AA * = I A *° “ A jo| , 1 < t < n . (40) 

Now, let {A ik, Cik ; k > 1} denote the solution to the difference equation obtained when 
the inequalities in (38) and (39) are replaced by equalities, with the initial conditions 


Cio — Ci 0 — t{ — 1 


A to — A t0 


Also let 


oo 


A *(p) = 5Z p k ’ c *( p ) = H C{k pk 

k = 0 k = 0 

whenever the series converge. Using well-known z-transform identities, 


(41) 


A,(p) - A io = \\ef Ai || p Ci(p) 


(42) 


Ci{p ) - c i0 = { II Ai || p Ci{p) + (A i(p) - A to ) c t (p)} 

Manipulating (42) and (43), we obtain the following quadratic equation 


( 43 ) 
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AA.(p)- ||«r A, II P=^{l|Alll pAA,(p) + A^(p)} 


(44) 


Mp) ~ ^ = — J |All| p ± 


After some manipulation, it can be shown that 


/ 1" AA t - - || A x || p ' 

2 

“ II 

/[ 2 j 



(45) 


IMp) - *»ol < |aX,-(p)| = |A,(p) - a i 


(46) 


|A,(p) A t0 < 


AA t - — A i p 


whenever 


oc i = 


ej Ai 

l|Ai|| 


1 - 


4AA t - ef Ai p 


(AA,- — || Ai p 1 1 ) 2 J 


, 1 < * < n (47) 


|Aip| < 2AA,- 


; + «*•- yj a , ? + Oi 


(48) 


Thus, the change in each of the n-eigenvalues has to be within the bound given by 
(47) as the parameter p varies around its reference value of zero. It is of interest to note 
that near the reference operating point, (47) can be approximated by 


|A»(p) A,- 0 | < 


ef Ai p 


1 - 


Aip|| 


1 < * < n 


(49) 


AA t - 


It is seen that these upper bounds depend on three real variables; namely, AA t -, ||A X p|| 
and || ef A x p||. In other words, the upper bound is valid and remains unchanged for any 
matrix A(p ) for which these three variables are constant. This will be discussed in more 
detail in the next section. The dependence on AA t - which is a measure of the closeness 
of the i th eigenvalue to the remaining eigenvalues is somewhat intriguing. From (36) and 
(37), it is seen that when two eigenvalues are close to each other, the sensitivity of the 
corresponding eigenvalues (as measured by c,* ) to variations in the matrix is greater. The 


13 


greater sensitivity in the eigenvectors then produces a greater sensitivity in the eigenvalues 
to variations in the matrix. 

It is also useful to note a more conservative upper bound on the eigenvalue variations. 
From (34), it can be shown that 

(A t0 1 - A 0 - Ai p) c,'(p) = — (A,(p) - A t - 0 ) a{p) (50) 

| A,(p) - A,o| < ||A t0 1 - A 0 - A x p|| , 1 < t < n . (51) 

In many cases, upper bounds such as these are too conservative to be useful. Note, for 
example, that at the reference of p = 0, the upper bound is not zero but ||A t0 7 — A 0 || which 
may well be quite large. This underscores the significance of the upper bound developed 
in this section given by (47). 


i 
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III. SOME MEASURES OF SYSTEM SENSITIVITY 


In the design of a control law, achieving a robust closed-loop system is among the 
most important goals. By a robust system, we mean one in which the significant system 
characteristics are “insensitive”, or have “little” sensitivity, to the expected variations in 
the system. For example, we may be interested in the sensitivity of location of the closed- 
loop system eigenvalues to variations in one or more system parameters. Thus, a measure 
of sensitivity would be given by the variation in one system characteristic caused by a 
variation in some other system property. 

It is important to note that a system may be insensitive to variations in some system 
parameters but be highly sensitive to other system parameters. Conversely, some system 
characteristics may be insensitive while others are highly sensitive to the same system 
parameters. For example, a system may well have a high stability margin, but have a d.c. 
gain which varies considerably as the operating point varies. Therefore, a single number 
or a single measure of robustness may not always adequately describe the robustness of a 
system. 

It is important to note that the system eigenvalues being insensitive to expected 
parameter variations does not necessarily imply that the location of the eigenvalues is 
the best for tracking commands. In other words, it is assumed that the designer has 
found the system’s nominal response characteristics, such as the location of the system 
eigenvalues, noise attenuation, etc., to be adequate for the basic purpose of the system. 
Therefore, in this study, sensitivity analysis is intended to evaluate the extent to which the 
system’s response characteristics vary from their nominal behavior. Sensitivity analysis 
does not evaluate the system’s performance of its basic purpose; e.g., tracking a time- 
varying command, or landing an aircraft. In fact, often a high performance system will be 
sensitive to critical system parameters. 

In most cases of interest, the system considered has parameters which are either not 
known with sufficient accuracy or which vary significantly over the system’s operating 
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range. Thus, it is natural to consider the system’s sensitivity to variations in these param- 
eters. However, the designer must also consider the system’s sensitivity to a number of 
other elements such as unmodeled dynamics, nonlinear dynamic effects, transport delays, 
sampling rate variations, component failures, disturbances, biases, etc. While investigating 
all of these elements is well beyond the scope of this study, it is important to note that 
each of these cases can be studied using the approach developed. This is an important 
difference between the approach developed here and the use of a-plots as measures of ro- 
bustness. Important design questions such as the change in a critical mode or eigenvalue 
due to jitter in the sampling rate or other parameters cannot be readily formulated using 
the latter approach. 

Possibly the most important of the elements mentioned above is the case of unmodeled 
dynamics. The way in which unmodeled dynamics affect the sensitivity of a system will 
be discussed next. 


A. UNMODELED DYNAMICS 

Most physical systems of practical interest are relatively complex nonlinear systems. 
To simplify their analysis, these systems are linearized at specific operating conditions 
within a operating range of interest and their approximations are introduced by neglecting 
terms of relatively small magnitudes. When the neglected terms contain variables which 
are themselves generated by a dynamic system, the effect of the approximation is difficult 
to assess and must be dealt with considerable care. 

While the neglected terms are generally of second order, the closed-loop system may 
nevertheless have desirable characteristics which are sensitive to these admittedly small 
terms. To avoid high sensitivity to unmodeled dynamics, attention must be paid in the 
design of the control law. 

Consider the system 

= A m x m + A mu x u ■+■ B m u , (52) 
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iu — A urn %m + A u x u + B u u (S3) 

where x m and x u are the modeled and unmodeled state vectors, respectively. The term 
Amu. Xu is neglected, the usual justification being that the part of x m due to the term 
A mu x u is much smaller than the part due to B m u. Thus, the modeled part of the system 
is 


x m — A m x m + B m u . (54) 

This is equivalent to simply setting A mu equal to zero in the “true” system given by 
(52) and (53), where the unmodeled state, x u , now has no impact on the modeled state, 
x m . Therefore, the eigenvalues of the modeled system are those of A m and A u as can be 
seen from the system matrix 


= (Am 0\ 
\ Aum Au J 


(55) 


where A m u has been set to zero. It can be shown that the matrix whose columns are the 
eigenvectors of A 0 can be partitioned as 


X - ( M x-i-fx- 1 0 \ 

— I yr V J > l y— 1 y— 1 / » 

\-^um / \^um / 

where X m and X u are the eigenvector matrices of A m and A Ui respectively, and 


(56) 


X um — %umi — (^mt I A u ) A um X m , 1 ^ ^ (57) 


ef XZi, = e? X~‘ A vm (A u< I - A m )~ l , 1 < i < n„ (58) 


x - 1 = (x m )-‘ , x-‘ = (x .)- 1 


(59) 
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Now the actual system matrix A differs from the modeled system matrix A a , by A A 


AA 

Thus, for this system 


/ 0 A mu \ 

\° 0 ) 


A = A 0 + AA 


( 60 ) 


AA = X" 1 A A X 0 


V-l 

^mu 

X um 

V ~~ 1 

A mu 

x u 

y-i 

^um 

Amu 

X U m 

Y-l 

A um 

A m u 

Xu 


(61) 


Using (29) and interpreting p to be unity, the first order change in the “true” eigen- 
values is 


A,i = tj h m (Xi)X m e,- , 1 < * < n, 


(62) 


Ail — X u A u (Ai)X u "t" f ^ * ^ “H (63) 


where 


Am (At) — Amu (At'/ Au') Aum » 1 ^ (64) 

A U (A,) = Aum{XiI -Am) -Amu j “I* 1 ^ < n m "h (66) 

If the matrix A m also varies by A^4 m , then the combined first order change in the 
“true” eigenvalues would be 

A fl = ef X- 1 [A A m + A m (A,)] X m e, , 1 < t < n m (66) 

From (66), it can be seen that up to first order, the effect of unmodeled dynamics on the 
system eigenvalues is essentially the same as that of parameter variations. When dealing 
with unmodeled dynamics, the transfer function, A m (s), evaluated at the i th eigenvalue of 
the model takes the place of the system parameter variations, AA m - 
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It is important to note that whereas AA m is usually a real matrix, h m (A,) is usually 
a complex matrix whose elements have both magnitude and phase. So that unmodeled 
dynamics of the same magnitude as parameter variations may produce larger changes in 
the corresponding eigenvalues if their phases are appropriately aligned. Thus, the system’s 
sensitivity to magnitude and phase variations is a measure of robustness with respect to 
unmodeled dynamics. 

Due to the mutual coupling of the modeled and unmodeled dynamics, the eigenvalues 
of the unmodeled dynamics also vary as the coupling, A mu , between the modeled and 
unmodeled, varies. This can be seen by observing (63) and (65). Therefore, if appropriate 
attention is not paid, the unmodeled dynamics may produce unacceptable and sometimes 
unstable modes. 

As can be seen from (64) and (65), in order to neglect dynamic modes satisfactorily, 
^m(A») and h u (A,) must be small. For the transfer functions h m (A t ) and h u (A t ) to be small 
it is necessary that the coupling terms A mu and A um be small, and, in particular, for the 
eigenvalues of A m and A u to be far apart from each other. The latter condition implies 
that the terms {(A,/ — A m ) _1 , 1 < t < n m } and {(A,/ — A u ) -1 , n m + 1 < * < n m + n u } 
are sufficiently small. It is important to note if the unmodeled dynamics have eigenvalues 
within the same range as the closed-loop modeled eigenvalues, then problems are likely 
to arise except for special circumstances. Thus, if the two sets of eigenvalues are not 
sufficiently separated, it is a safer policy not to neglect the modes under consideration 
in the system model. The use of stochastic optimal output feedback is usually quite 
convenient in such cases. 

In many cases of practical interest, it is convenient to neglect the dynamics associated 
with the control actuators and with the sensors used for feedback. This can reduce the 
order, hence the complexity, of the system under consideration significantly. Also the 
higher order structural modes of a physical system as well as the higher harmonics of the 
electronic subsystem are usually neglected. These unmodeled dynamics usually consist of 
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higher frequency modes than the modeled modes. 

From the previous discussion and (62) - (66), it is clear that to obtain insensitivity to 
unmodeled dynamics, it is necessary that the designed closed-loop eigenvalues be separated 
from the unmodeled eigenvalues. Since these unmodeled eigenvalues are of high frequency 
and can vary significantly, it is desirable to design the closed-loop eigenvalues with suffi- 
ciently low natural frequencies so as not to excite the unmodeled eigenvalues. Therefore, 
unmodeled dynamic effects place an upper limit on the closed-loop eigenvalues and on the 
gains that can be used in the control law design. System sensitivity to other effects also 
place an upper limit on the closed-loop eigenvalues, as will be seen in the following section. 

When considering the system sensitivity to unmodeled dynamics using the approach 
developed here, it is clear that the control law to be designed must not result in closed- 
loop eigenvalues which are “too far” into the left half-plane or too high frequency. In other 
words, the control law gains must not be “too high” if we are to avoid high sensitivity 
to unmodeled dynamics and maintain robustness. While most control designers of actual 
systems know the rule-of-thumb that “high-gain” control laws produce problems, usual 
robustness measures do not reflect the trend of high sensitivity introduced high gain 
systems. 


B. AN UNMODELED SENSOR DYNAMICS EXAMPLE 

The meaning and usefulness of the measures of sensitivities being developed in this 
study would be better appreciated when applied to an example. We will select a simple, 
but representative, example to illustrate each of the measures investigated here. 

Consider a projectile which is approximated by a point mass m. The velocity and 
thrust along the x-direction axe v x (t) and T x (t), respectively. It is assumed that the 
altitude profile is independently controlled by the vertical component of the thruster, T z . 
As the nominal system, we will assume that the drag on the projectile is negligible; so that 
the nominal system is given by 
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( 67 ) 


X = V T 


V x = 


m 


( 68 ) 


Suppose that we want to design a control law which regulates the velocity v x (t) about 
a commanded value u zc . We would like to have no steady-state error in the presence of 
steady winds, and despite the fact that the mass, m, may vary ± 10% due to loss of fuel 
during flight and variations in the initial mass, and that the aerodynamic forces can be 
reduced to the drag force resulting in 


v x = ~ a 2 v x H T x + w 


m 


(69) 


where the coefficient a 2 may vary within the set [0, .2] and w(t ) is a Gaussian white noise 
process with zero mean. 

Let us formulate the nominal state model for this problem in the following way. 


£2(0 — ^x (0 


z(t) = V xc {t) 


(70) 


b — , u {t) — T’j. (t) , 

m 


(71) 


&l = £2 — z , 

(72) 

z 2 = 6 u + w 

(73) 


Note that zi is the integral of the velocity error. This control structure is chosen 
specifically to meet the requirement that the steady-state velocity error be zero. Using the 
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Stochastic Optimal Feedforward/Feedback methodology, close the loop using any accept- 
able feedback design. 

Suppose that the following controller meets the designer’s closed-loop requirements. 

u = -ki xi - k 2 x 2 + v , (74) 

where v contains the feedforward terms. 

Closing the loop, we obtain 


X 1 —X 2 -Z , (75) 

X 2 = —b ki xi — b k 2 X 2 + b v + w . (76) 

In this section, we will investigate the implications of unmodeled dynamics on this 
system using the sensitivity measure developed in the preceding section. In the following 
sections, the same system will be investigated using the system sensitivity to other ele- 
ments. Where convenient, the sensitivity measures developed here are compared to other 
robustness measures. 

From the feedback control law shown in (74), it is clear that a measurement of the 
velocity, X 2 , is necessary to implement the controller; x\ can be computed as part of the 
control law and therefore is known. 

Suppose that this velocity is being measured using an on-board sensor which may be 
described by 


x„ = —a x u + a X 2 + tu u , a > 0 (77) 

where x u is the actual sensor output and w u is the random sensor noise. The neglected 
sensor dynamics may produce effects which must be accounted for. Sensors which have 
relatively fast dynamics (i.e., relatively high a value) can justifiably be neglected in the 
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design model provided that the control designer places appropriate restrictions on the 
control law. As will be apparent from the following, significant consequences may result 
from neglecting even fast sensors if the control law is not properly designed. 

To investigate the effects of the unmodeled sensor using the sensitivity measure de- 
veloped in the last section, first note that the actually implemented control law will not 
be (74), but will be 


u = —ki xi - k 2 x u + v . (78) 

To put the example into the form used in the last section, we rewrite the closed-loop 
system with the change of variables 


Ax u = x u — x 2 


(79) 


x 2 = — b ki xj — b k 2 x 2 — b k 2 Ax u + b v + w 


(80) 


A i u = -a Ax u - x 2 + w u 


(81) 


Ax u = +b ki xi + b k 2 x 2 — (a — b k 2 ) Ax u — b v + ( w u — w ) (82) 

Thus, the closed-loop system matrix for the state vector [x\ x 2 Ax u ) T is 


0 

l 

0 

-bk x 

-bk 2 

— bk 2 

bki 

bk 2 

— ( a — bk 2 ) 

Amu 

= ( ° ^ 
V-^2, 

\ ^ 
J 5 


(83) 


(84) 


From (82) as well as (83) and (84), it is clear that as the gain k 2 increases, the 
dynamics for Ax u in (82) becomes less stable, until it actually becomes unstable! It is 
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seen that high gains have the tendency of making a system highly sensitive to unmodeled 
dynamics. 

To compute the sensitivity to unmodeled sensor dynamics, we first obtain the transfer 
function, /i m (A t ), given by (64). 

h m {Xi) = f _j)3 fc, -b 2 k l 1 > i=l,2 . (85) 

\ Xi+at — bki A,+a — b)c2 ' 

The sensitivity of the system eigenvalues to the unmodeled sensor dynamics can be 
found to be 



Observing (86), the basic elements that affect robustness with respect to unmodeled 
sensor dynamics become clear. The system sensitivity to unmodeled sensor dynamics 
increases as 

1) the control gains ki and k 2 increase 

2) |A; 0 + a — bk 2 \ decreases 

3) the distance between the eigenvalues, | Aio — A 20 I decreases. 

Most control designers quickly become aware of the fact that as the feedback gains 
are increased, the system robustness is significantly reduced. However, if the system gains 
are kept low, the control performance during transients due to disturbances or noise is not 
satisfactory. Determining gains which are high enough for acceptable transient response 
and tracking, yet which are low enough to be insensitive to unmodeled dynamics is among 
the most difficult control design problems. The fact that the sensitivity measure developed 
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here provides insight into the reasons for some well-known rules-of-thumb in control design 
makes this measure of robustness useful. 

However, currently the most popular measure of robustness for multi-input multi- 
output systems, namely the smallest singular value of the return difference, fails to indi- 
cate that the system sensitivity to unmodeled dynamics (in fact, other elements as well) 
increases significantly with increasing control gains. In fact, just to the contrary, the mea- 
sure of robustness seems to claim that as the feedback gains increase the robustness of 
the system increases. To illustrate the point, note that the smallest singular value of the 
return difference for the example system is 


a{I + G(jw) K(jw)} = g(l + ) 


( 88 ) 




(M») ! 

U?2 


1/2 


( 89 ) 


where G(jw) is the open-loop transfer function from u to x\. It is seen that as k\ and k 2 
increase the smallest singular values also increase at every frequency. This implies that the 
system with the higher control gains is the more robust one. Clearly, the singular value 
of the return difference seems to contain no hint or clue about high gains causing high 
sensitivity to unmodeled dynamics which may even result in instability. 

It should be noted that this is not an anecdotal occurrence. Singular value analysis 
seems to show a preference for high gain systems in almost all situations. Let G(s) be 
the open-loop plant transfer function and K(s ) the equivalent feedback control transfer 
function. Then, singular value analysis suggests the smallest singular value of the return 
difference matrix as a measure of system robustness; i.e., 


a {/ + G{jw) K(jw)} 


( 90 ) 


As the control transfer function increases in norm, eventually the smallest singular 
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value of (90) will also increase. This implies that if the control gains are high enough, 
the system will be robust, which does not agree with the sensitivity results shown in this 
section. Therefore, is seems possible that a system be thought to be robust according to 
singular value analysis while having high sensitivity to unmodeled dynamics, as illustrated 
by the simple example in this section. Although it is possible to limit consideration to 
lower gain designs, the fact that the signular values of the return difference do not reflect 
sensitivity to unmodeled dynamics within the set limits remains unchanged. 

C. EIGENVALUE AND EIGENVECTOR SENSITIVITY 

In the previous sections, a sensitivity measure for the effects of unmodeled dynamics 
was developed and its use was demonstrated with a simple example where the sensor 
dynamics were neglected in the design model. In this section, we will investigate the 
sensitivity of the closed-loop eigenvalues to system parameter variations. In particular, 
we will consider the location of eigenvalues, the sensitivity of the damping ratios and the 
stability margin. Finally, the sensitivity measures developed will be illustrated using the 
example of the last section. 

System parameter variations are quite common in practical systems. The question 
of sensitivity of eigenvalues occurs in three related but different situations. First, it is 
desirable to know whether a relatively small change in one or many parameters produces 
an inordinate change in any one eigenvalue. If these parameters can be expected to vary 
under the operating conditions of the plant, then it may be desirable to modify the feedback 
control law to reduce high sensitivities. It is further desirable to know the direction in which 
the eigenvalue will move to evaluate whether this sensitivity is indeed undesirable. 

Second, and probably most important, it is necessary to establish that the closed-loop 
eigenvalues and eigenvectors remain within an acceptable range of values while the system 
parameters vary over the operating range. In this case, the system parameters admittedly 
will have significant variations. It is also to be expected that the system response, as 
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described by its eigenvalues and eigenvectors, will have correspondingly non-negligible 
variations. It is important however, that the system response remain within an acceptable 
range. In cases where this is not possible, it becomes necessary to use gain scheduling 
or nonlinear designs in order to maintain the system response satisfactory throughout the 
operating range. 

Finally, the designer must consider at least some of the more common, but accidental, 
large parameter variations. For example, component failures, accidental human errors, etc.; 
in other words, situations which are not within the normal operating modes, but which 
may at least temporarily occur. In such cases, it is desirable that the system maintain its 
stability, even if the system response is not within the satisfactory range. 

Now consider an analog or digital system described by (l) or (2), respectively. Suppose 
that the control designer has selected the following control laws using the feedback vector, 

y- 


y = C x + v , y k = C x k + v k ; (91) 

u = —K y — —K C x — K v + u , u k = —K y k = —K C x k — K v k + u k (92) 

where v and v k represent analog and discrete sensor noise and errors, and u and u k are 
the analog and discrete feedforward controls, respectively. Closing the loop with these 
controllers, 


x = (A — B K C) x + Bu + w — BKv , 


(93) 


xk+i = (<t> — r k c) xt + r uk + u>k — r k Vk > 


(94) 


where w and w k represent analog and discrete plant noise, respectively. 
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The feedback design may be obtained using any method which pays the necessary 
attention to the stochastic plant and measurement noises as well as the requirements of 
the feedforward controller. These include classical and modern, frequency and time domain 
approaches to control design. However, in this study, the method of feedback design is not 
relevant. Whatever the method used, here we would like to develop criteria which will help 
evaluate the sensitivity of the closed-loop system response to system parameter variations. 

First note that, from (93) and (94), we are interested in the sensitivity of the eigen- 
values and eigenvectors of the closed-loop system matrices [A — B K C) or (<J> — T K C) 
according to whether the system is continuous or discrete, respectively. Since the form of 
both system matrices is the same, we will treat only ( A — BKC ) with the realization that 
A and B can be replaced in the formulas by <f> and T, respectively, when dealing with a 
discrete system. 

1. Small Parameter Variations. 

When considering small changes in the system parameters, it is usual to use the first 
derivative of the eigenvalue with respect to the parameter as a measure of sensitivity. 
Observation of the infinite series representation in (5) reveals that the first term, A,-i , is in 
fact the derivative of the i th eigenvalue with respect to the parameter, p. From (29), it is 
seen that if the system matrix varies in the form of 

A{p) = {A 0 -B 0 KC) + ( A l -B l KC ) p (95) 

Then the sensitivity of the t th eigenvalue, A t0 , to the parameter p may be defined as 

A<i = {A x - B\KC) X 0 e t - , 1 < t < n (96) 

where X 0 is the eigenvector matrix of (A 0 - B 0 KC)\ i.e., the nominal closed-loop system 
matrix. 

A measure of the average sensitivity can be obtained by 
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( 97 ) 




It should be noted that while S p may provide a quick idea of the eigenvalue sensitivity, 
the information about the direction and the particular eigenvalue has been eliminated in 
the process. 

Now, consider the (t, j) element of the system matrix to be the parameter in question; 
then we can define the (t , j) element of the Sensitivity Matrix, say S , as 


S = 




k=l 


1/2 


1 < t,j < n 


(98) 


where X^ 1 and X# are the (t, j) elements of X" 1 and X 0 , respectively. 

In other words, the (t,j) element of the Sensitivity Matrix is the average change in 
the system eigenvalues due to a unit change in the (*,/) element of the closed-loop system 
matrix. 

A first order approximation to the Stability Margin Matrix, M, may be obtained by 


Mij = min 


Kfc<n 


X jk } 


]■<>,]<* 


(99) 


It is seen that M,y is the change in the (i,j) element of the closed-loop system matrix which 
would produce instability, assuming the first order approximation holds. The matrix M 
provides relative, local information about the stability margin. Higher order approxima- 
tions of the stability margin can be obtained by adding more terms such as , A ,3, etc. 
In other words, using a higher order approximation of the power series for the eigenvalue, 
it is possible to obtain as much accuracy about the stability margin as required. 

A 4 th order longitudinal dynamics model for a Boeing 737 aircraft at different air- 
speeds is analyzed in Tables 1, 2 and 3 using the Sensitivity Matrix and the Stability 
Margin Matrix proposed above. In Table 1, the aircraft nominal speed is 125 knots (V 0 ). 
The parameter under consideration, p, is defined as the deviation of the airspeed from the 
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selected nominal value. The aircraft dynamics, hence the system matrix, A(p), varies with 
the deviation from the nominal airspeed as shown in Table 1. The Sensitivity Matrix indi- 
cates the relative impact of the system matrix elements on the eigenvalues. For example, 
the average change in the absolute value of the system eigenvalues to a unit change in the 
(2, 1) element is 0.255, while for the (3, 1) element it is 30.3 and for the (2, 4) element it 
is 0.00196, up to first order. 

It is clear that the aircraft eigenvalues are highly sensitive to the (3, 1) element of the 
system matrix, whereas the sensitivity to the (2, 4) element is quite small. Therefore, the 
relative importance of the various elements of the system matrix is easily seen by observing 
the Sensitivity Matrix. On the other hand, if the airspeed varies from the nominal value 
by 1 knot, all the system elements vary simultaneously. In that case, the average change 
in the eigenvalues is given by S p which is 0.00998 for the example in Table 1. 

Two measures of stability margin are shown in Tables 1, 2 and 3. M is the margin to 
real parameter changes, whereas M u is the margin to unmodeled dynamics. As shown in 
Section III A (Eq. 66), the first order change due to unmodeled dynamics can be obtained 
by replacing the real parameter variation matrix (AA m ) by the unmodeled transfer func- 
tion matrix, h m (Afc). Thus, the elements of M u are defined as the change in h m { A*) which 
would produce instability, assuming a first order approximation and noting that h m { A*) is 
a complex-valued matrix. From Table 1, it is seen that the stability margin to unmodeled 
dynamics is smaller than the margin to parameter variations. Thus the relative stability 
margin of the system elements can be obtained by the matrices M and M u . 

2. Large Parameter Variations. 

The local eigenvalue sensitivity measures described in the last section are quite valu- 
able in evaluating the local robustness qualities of a system. On the other hand, in most 
design problems, it is necessary to consider a larger region about the nominal operating 
point and make sure that the system response remains within satisfactory bounds. 

The usual way of thinking of system sensitivity, or robustness, is that it can be de- 
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scribed by a number, a set of numbers and, in the case of singular value analysis, a function 
of frequency. These approaches provide useful information about the sensitivity of a sys- 
tem. In this section, we will introduce a new way of thinking about system sensitivity and 
robustness which, in our opinion, is better equipped to deal with realistic design problems. 

In most control design problems, the design engineer has an operating range, i.e. the 
set of operating points, and a set of acceptable system response variations from a nominal 

acceptable response at the nominal operating point. For current purposes, we will limit the 

l 

system response to characteristics which can be determined from the closed-loop system 
eigenvalues, such as natural frequency, damping ratio, stability, etc. 

Thus, the main question is whether the system eigenvalues remain within the accept- 
able region while the system matrix varies within the operating range. It is important to 
keep in mind that not all the elements of the system matrix are subject to variation or 
uncertainty. Many elements of the system matrix remain completely constant throughout 
the operating range. Therefore, it is important to make use of such information to the 
extent possible. 

When the parameter variations within the operating range are large, the sensitivity 
measures described in the last section are not applicable. However, the upper bound 
obtained in Section II C becomes a very useful tool both quantitatively and in providing 
insight on the design process. Now, let 

A = A-BKC , A 0 = A 0 - B 0 KC 0 (100) 

i 

I 

l 

AA = A- A 0 = AA- ABKC - B 0 K AC (101) 

AA = X~ l AA X 0 (102) 
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_ |[ef AA)| 
l|AA|| 


a _ IIaah 

Pt A A, 



Then the upper bound in (47) can be rewritten as 


1 < « < n (103) 


\ - 

- A* 

/ 1 -Pi 

1 ill- A<XiPi 


A lO 

- 2 

V a -*) 2 J 


A A,- 


1 < i < n 


(104) 




0 < Pi <1 


<*i < 1 


1 < * < n 


(105) 


Thus, given the amount of variation in the open-loop parameters, namely AA, A B and 
AC, (104) provides a limit on the change in every eigenvalue when the three parameters 
a,-, Pi, A A i axe known. It is important to have individual limits for each eigenvalue, because 
large and complex systems tend to have eigenvalues at widely varying locations of the 
complex plane. 

A few remarks are worthy of note. Possibly, the most significant point is that the 
change in eigenvalues is still monotonic with AA even though we are no longer dealing 
with the first order variations, but rather the total change as bounded by (104). 


||A A|| = HAT" 1 (A — A 0 ) X 0 \\ = WXo 1 (AA — AB KC — B 0 K AC) X 0 \\ (106) 

It should be noted that whereas the system response is largely dependent on the 
location of the eigenvalues, the system sensitivity is highly dependent on the eigenvectors; 
i.e., the columns of X 0 . It follows that the system eigenvectors should be selected so as to 
minimize the effects of the largest variations in the system parameters; i.e., AA, A B and 
AC. 
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From (103) and (104), it is seen that the relative location of the eigenvalues also plays 
a role in the sensitivity of the eigenvalues due to AA,-, or the minimum distance between 
the i th eigenvalue and the remaining ones. This dependence appears to be not as strong. 

If the eigenvalues and eigenvectors of the system matrix can be selected independently, 
it would seem that the eigenvalues would be selected to produce the necessary noise attenu- 
ation, transient response, feedforward bandwidth requirements, etc. Then the eigenvectors 
could be selected to minimize the system’s sensitivity to parameter variations resulting in 
X 0 A 0 X~ l as the closed-loop system matrix A 0 . 

However, in most systems of practical relevance, the eigenvalues and eigenvectors can- 
not be selected independently. If the feedback gains are selected to place the eigenvalues, 
usually the eigenvectors are also fixed, and the system may have very high sensitivity. 
Thus, pole placement alone does not usually result in acceptable robustness. Since plant 
and sensor noise as well as other considerations must also be included, the use of stochas- 
tic optimal output feedback multi-configuration control techniques are useful in trying to 
achieve an acceptable compromise among the various goals of feedback compensation for 
a given task. 

The extent of variation or uncertainty among system parameters can vary consid- 
erably. While some parameters representing kinematic relationships do not vary at all, 
others may double. Therefore, it is desirable that our measure of sensitivity be able to ac- 
commodate such important information about the structure of variations. A system which 
is sensitive to parameters with low or no variability, but which is insensitive to parame- 
ters with high variability should be considered robust. Since the elements of A A, A B and 
AC which do not vary can be set to zero in computing ||AA||,a,- and the structural 
information about the extent variability is automatically included in the upper bound of 
the eigenvalue change. When such structural variability is not specifically taken into ac- 
count, the full condition number of the closed-loop system matrix A 0 would determine the 
sensitivity. 
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I|AA||<(I|*.- , |I IIX.II) P-A.ll 


(107) 


Another significant property about the sensitivity measure in (104) is that it provides 
upper bounds for each eigenvalue. For example, suppose the closed-loop system has a pole 
close to the origin, while the remaining eigenvalues are farther in the left-half-plane. The 
mere fact that a pole is near the origin does not, of itself, imply that the system has low 
stability margin. What is important is the sensitivity of the pole to parameter variations. 
Often the poles far in the left-half-plane are the first to become unstable. 

From (104), it can be shown that if the i th row of Xq 1 (i.e., the i th row eigenvector of 
A 0 is orthogonal to the change in the system matrix, A A, then the t th eigenvalue remains 
unchanged. In fact, if a,- is small, then the total change in the i th eigenvalue will also 
be small. In other words, if some eigenvalues need to be more robust than others, then 
this insensitivity may be obtained by making the corresponding row eigenvector nearly 
orthogonal to the system variations; i.e., a t - « 0. 

It should be noted that the norms in (103) for a» and ft can be arbitrarily selected 
matrix norms. For example, if the 2-norm is used, then ||A A|| is the largest singular value 
of A A. Other norms such as the 1-or the oo-norms may sometimes be more convenient. 

For a fixed ft in (104) the change in the eigenvalue |A,- — A,- 0 | is monotomic with a,-. 
Therefore, if a, is set equal to 1, the inequality in (104) still holds. 

It is sometimes more convenient to use the normalized variable x,- instead of the upper 
bound of | A** — A t0 |. Making this substitution and after considerable manipulation it can 
be found that 


ft = *; ( * , 1 < > < n . (108) 

(a,- + x,) 

This equation is equivalent to (104) where x t - is the upper bound on the change in the 
t th eigenvalue normalized by AA except that it solves for ft in terms of x, and a,-. Note 
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that the normalization has eliminated the variable AA,-; so that it is no longer explicitly 
shown in the equation. Figure 1 shows the class of plots of /?,- versusx,- at various levels of 
a { . 

It is also possible to ask the reverse question: If it is required that eigenvalues of the 
system remain within given regions, what is the region of operating points, or the set of 
system parameters, which can be allowed? i.e., what is the operating regime? 

A straight-forward approach to answer this important question may be developed as 
follows. Suppose the required regions for the eigenvalues can be expressed by 

| A* Ato| < <]i ) 1 ^ < n (109) 

Then, it can be shown that any AA such that 

||X-'AA*.||< M ■ (HO) 

and 

\\efX- l AAX 0 \\<OLi\\X- l AAX 0 \\ , l<t<n (ill) 

is in the acceptable operating range, in the sense that the system eigenvalues will satisfy 
(109). The selection of a,- is not always straight forward. In such cases a,- = 1 may be 
used, although this is likely to produce conservative results. 

Thus, with the procedure presented, it is possible to see if a variation in the system 
parameters produces an acceptable variation in the each eigenvalue. Or conversely, given 
an acceptable range of variation for each eigenvalue, a set of parameters within which 
the system eigenvalues are each within their acceptable range can be obtained. These 
procedures will be illustrated using the example system introduced in the last section. 

Finally, it is seen that while only the diagonal elements of the matrix AA are needed 
to obtain the derivatives of the eigenvalues, the sensitivity to larger parameter variations 
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is influenced by all the elements of AA. Furthermore, the variations in the eigenvectors 
are also highly influenced by all the elements of AA. Finally, the sensitivity of the system 
transfer function is also directly proportional to AA, but is beyond the scope of this 
investigation. 

Therefore, the sensitivity of a system cannot be fully understood or evaluated by only 
the diagonal elements of AA, but must consider the complete matrix. From Figure 1, it is 
clear that the eigenvalue sensitivity and the norm ||AA|| are monotomic. The slope of the 
relationship is determined by a,- which contains information about the particular row of 
AA. Therefore, when only the relative sensitivity of two systems is needed, as in a design 
optimization, ||e^AA|| and ||AA|| provide a relative sensitivity measure that can be useful. 
In particular, recall the approximation 


I At — A i 0 < 


<MAAJ| 

^ II A 1 II 


1 - 


A A; 


1 < * < n 


Now, we return to the example introduced in Section III B to illustrate the use of the 
sensitivity analysis procedures developed in this section. The open-loop system is given by 
(72), (73), the control by (74) and the closed-loop system by (75), (76). The closed-loop 
matrices of interest can be found to be 


A 0 


0 1 \ 
LI- LI-/ 



0 


-Aa 2 - (^)&o* 2 


( 112 ) 


Xo = 







(113) 


A A = X~* A AX 0 

1 / — A6(fc| + fc 2 Aio) — Aa 2 Aio 

A 2 o ~ Aio V A6(A:i + A 2 Aio) -b Aa 2 Aio 


— A6(fci + fc 2 A 2 o) — Aa 2 A 20 \ 
A b[ki + £ 2 A 2 o) + Aa 2 A 2 o ) 
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After some manipulation, 


/ 


AA = 


Aio - A20 


\ 


(115) 


^10 (jtr) ~ ^io ^°2 ^20 (^) — A 2 oAa 2 

^10 (^r) ~ A10A02 — ^20 (^) + A2oAa2 j 

where Ai 0 , A 2 o are the nominal closed-loop system eigenvalues. 

As mentioned in Section III B, the drag term Aa 2 x 2 and the mass vary within limits 


which can be approximated by 


—.2 < Aa2 < 0 



(116) 


The designer of the feedback controller selects the gains ki and k 2 based on a number 
of objectives imposed by the task at hand such as the transient response requirements, 
measurement and plan noise suppression, the bandwidth of the class of feedforward com- 
mands, sensitivity to system parameters and unmodeled dynamics, etc. Once the selection 
of the feedback gains is made, it is of interest to check whether the eigenvalues of the 
closed-loop system remain within acceptable bounds for the other control objectives as the 
parameters Aa 2 and A6 take on various values. The procedure developed in this section 
may be used for this purpose. 

Now, suppose that, using the nominal system, the designer has selected gains 


b 0 ki—2 , b 0 k 2 = 2 
which correspond to the critically damped eigenvalues 


(117) 


A 10 = — 1 + j , A 20 = — 1— j . (118) 

Figure 2 shows the closed-loop eigenvalues and the regions which the designer considers 
acceptable in terms of damping, noise suppression, etc. First compute the norm ||AA||, a,- 
and Pi- In this example we will use the 2-norm. After some computation, 
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AA t * = | A A| = | A xo “* A20 = | A 20 — A 10 = 2 | A xo sittO — 2 , 1 = 1, 2 (120) 


First consider Aa 2 . 


a _ 2|Aio| 

Pt ~ |AA| 2 


|Aa 2 | = 


lAa 2 | 

sind | A A| 


|Aa 2 | 

v/2 


( 121 ) 


Pi < 0.1414 , a,- = V2/2 

Using (104), we find that 


( 122 ) 


|A t - - X io \ < 0.278 , t = 1, 2 . (123) 

The eigenvalues are seen to remain within an acceptable region as Aa 2 moves within 
its expected limits. Clearly, using a nominal design system with an a 2 value of 0.1 would 
reduce the change Aa 2 to [-.1, .1] and would have further margin. Also note that the value 
obtained is a conservative upper bound. On the other hand, the first order variation 

An Aa 2 = - (^ ) Aa 2 (124) 

also provides important information about the eigenvalue changes, but does not contain 
information about the eigenvector variations. In many cases, A,i and A,- 2 may provide 
sufficient accuracy. On the other hand, change in b produces a simultaneous variation in 
both system parameters. From (119), 
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0i = 


A b 


2|A.„| 2 

Ab 


bo 


Ab 

| AA| 2 

b 0 

2 sin 2 6 

bo 


Using (104), 


* = 1 , 2 


(125) 


|Ai - A,„| < 0.174 , i = l,2 , (126) 

which is also within the acceptable region. When both Aa 2 and A b vary, the upper 
bound will exceed the acceptable region. However, the region obtained is still not that 
large considering the conservative nature of the upper bound. A different design may be 
necessary if the damping requirements must be maintained. 

On the other hand, it is possible to characterize the set of parameters which guarantee 
the eigenvalues remain within their acceptable regions. 

Using (108) with a equal to \/2/2, and substituting into (119) and manipulating 


1 

2 



A 10 Aa2 


< .204 


Further manipulating, 

(tt) + ((^) +Aa2 ) -- 0832 

From (128), it cam be seen that an operating where 


(127) 


(128) 


Ab 


< -1 


and .17 < Aa 2 < .17 


(129) 


can be guaranteed to remain within the acceptable region of eigenvalues. However, if 
Aa 2 = 0, then b may vary by over ± 20%, while at a fixed b 0 , Ad 2 may vary within [-.288, 
.288]. 

Finally, from (119), (121) and (125), it may be noted that insensitivity of eigenvalues 
and eigenvectors with respect to system parameters does not lead towards the choice of 
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high control gains, whereas high gains can lead to high sensitivity to unmodeled dynamics. 
Therefore, the smallest singular value of the return difference, as shown in (89), seems 
to be more a measure plant noise suppression and fast transient response characteristics, 
rather than the sensitivity of system characteristics to plant parameters. 
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IV. CONCLUSIONS 


In the design of the feedback control law, the closed-loop system’s robustness is among 
the most important considerations. By robustness, we mean that the system characteristics 
are sufficiently insensitive to expected system parameter variations to continue to perform 
the basic system objective in an acceptable manner. The expected system parameters 
considered here are the variations of the open-loop system matrices (A, B, C) over the 
desired operating range, uncertainties in these parameters and neglected unmodeled system 
dynamics. 

In this report, some measures of eigenvalue and eigenvector sensitivity which are 
applicable to both digital and analog systems are developed and investigated. Since the 
eigenvalue and eigenvectors of the closed-loop system completely specify the feedback char- 
acteristics of the closed-loop system, if the eigenstructure of the system remains within 
acceptable limits defined by the feedback designer, then the essential system characteristics 
also remain within acceptable limits, resulting in a robust system. 

Formulating the system matrix as a function of a parameter, p, the eigenvalues and 
eigenvectors are expressed in a power series representation. The coefficients of both power 
series can be obtained from a recursive difference equation. Therefore, the variations in 
the eigenvalue and eigenvectors can be obtained as a function of p with as much accuracy 
as desired. Finally, an upper bound on the change in each eigenvalue and eigenvector is 
obtained. Due to the development of these infinite series representations, it is no longer 
necessary to constrain the sensitivity analysis only to first derivative information. A more 
complete exploration of the implications of the power series representation is left for future 
research. 

A new sensitivity measure is developed by considering the effects of neglected un- 
modeled dynamics. Since almost any physical system is modeled neglecting some of the 
dynamics, this measure of sensitivity is useful in most applications. This sensitivity mea- 
sure indicates that neglecting dynamics affects the actual system eigenvalue variations in 
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direct proportion to its transfer function evaluated at the modeled eigenvalues. Thus, the 
closer the modeled and unmodeled eigenvalues get, the larger the sensitivity, and con- 
versely. Since most unmodeled dynamics are high frequency effects, this sensitivity places 
a limit on the magnitude of the gains that can be used in the feedback law. 

This property is demonstrated by considering a simple system design where the dy- 
namics of a velocity sensor is neglected in the design model. It is demonstrated that 
a high-gain feedback results in high eigenvalue sensitivity. This demonstrates that high 
gains cause robustness problems due to unmodeled dynamics rather than just high control 
activity. 

Analyzing the same example with the smallest singular value of the return difference, 
it is seen that this singular value is not a reliable measure of eigenvalue and eigenvector 
sensitivity, but may be more appropriate as a measure of plant noise suppression and fast 
transient response. 

Finally, a measure of sensitivity to system parameter variations is developed using 
the upper bound previously obtained. This is used to establish the robustness of a system 
by showing that the expected system parameter variations produce eigenvalue variations 
within acceptable regions. The sensitivity measure also increases with high feedback gains 
although not to the same extent as sensitivity unmodeled high frequency dynamics. 
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TABLE 1 


EIGENVALUE SENSIIVITY (S) AND STABILITY MARGIN 
MATRICES FOR LONGITUDINAL DYNAMICS 
OF A SMALL JET AIRCRAFT 


Analysis Parameter: airspeed v in knots 


A(p) = A 0 + A lP , p = (V - V 0 ) 


Nominal Flight Condition for A 0 

Vo = 125 knots , <j> = 0. , Wt = 80, 000. lbs. , c.g. 0 = .2 

Ao = -.632 ±j 1.15 ; -.0141 ±j. 16 
A 0 A i 


u 

-.409E-01 
— . 286E+00 
— • 521E-03 
. OOOE+OO 

xv q 

. 965E-01 -. 340E+01 
— . 728E+00 . 216E+03 

— . 621E-02 — . S22E+00 
.OOOE+OO . 100E+01 

0 

322E+02 
806E+00 
. 280E-1S 
. OOOE+OO 

u 

. 573E-03 
. 755E-04 
. 187E-04 
. OOOE+OO 

w 

. 290E-02 
. 153E-01 
. 602E-04 
. OOOE+OO 

9 

690E+00 

175E+01 

.416E-02 

.OOOE+OO 

9 

• 33 IE— 02 
lllE+OO 
196E-15 
. OOOE+OO 


s 


Sensitivity 




U 

W 

9 

9 

S p = .998 E — 2 



. 353E+00 

. 976E-01 

- 524E-03 

. 186E-02 





. 255E+00 

. 357E+00 

. 191E-02 

. 196E-02 





. 303E+02 
. 705E+02 

. 654E+02 
. U1E+02 

• 351E+00 
. 59QE-0 1 

. 309E+00 
. 36SE+00 

II 

sf 

64.1 






M 

Stability Margin 

M u 


u 

tv 

9 

e 

U 

w 

9 

0 

. 283E-01 

. 184E+00 

. 340E+02 

. 31 1E+02 

.282E-01 

. 18XE+00 

. 338E+02 

* S44E+0 1 

. 776E+00 

. 126E+01 

. 194E+03 

• 796E+01 

• 390E-01 

. 251E+00 

• 469E+02 

* 753E+01 

.272E-01 

.542E-01 

. 128E+01 

.664E-01 

. 329E-03 

•212E-02 

. 396E+00 

.636E-01 

. 114E+01 

. 178E-01 

• B81E+00 

.284E-01 

. 1 4 IE— 03 

. 909E-03 

. 170E+00 

• 272E—01 
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TABLE 2 


EIGENVALUE SENSIIVITY (S) AND STABILITY MARGIN 
MATRICES FOR LONGITUDINAL DYNAMICS 
OF A SMALL JET AIRCRAFT 


Analysis Parameter: airspeed V in knots 


A( P )=A 0 + A lP , p = (V-V 0 ) 


Nominal Flight Condition for a 0 
V 0 = 135 knots , 0 = 0. , Wt = 80, 000. lbs. , c.g. Q = .2 

A 0 = -.777 ± j 1.25 ; -.0161 ± j .137 


A 0 


A i 


u 

— . 466E~01 
-.2BSE+00 
— . 706E-03 
. OOOE+OO 


W 

.687E-01 
. 976E+00 
•689E-02 
. OOOE+OO 


9 

. 106E+01 
. 233E+03 
. 564E+00 
. lOOE+Ol 


0 

-.322E+02 
. 146E+00 
-.560E-15 
. OOOE+OO 


U 

. 573E-03 
. 755E-04 
. 187E-04 
. OOOE+OO 


XV 

. 290E-02 
. 153E-01 
. 602E-04 
. OOOE+OO 


9 

— • 690E+00 
175E+01 
• 4 1 6E-02 
. OOOE+OO 


0 

.33 IE-02 
lllE+OO 
196E-15 
. OOOE+OO 


S 


Sensitivity 


u 

. 352E+00 
. 265E+00 
. 377E+02 
• 819E+02 


XV 

.906E-01 
. 358E+00 
. 653E+02 
. 126E+02 


9 

. 452E-03 
. 194E-02 
. 355E+00 
. 513E-01 


e 

. 159E-02 
. 176E-02 
. 293E+00 
. 366E+OG 


S p = .979 E-2 
M p = 72.2 


M 


Stability Margin 


M u 


u 

. 325E-01 
• 543E+00 
. 982E-02 
. 127E+01 


tv 

• 213E+00 
. 156E+01 
. 364E+00 
.335E-01 


9 

. 525E+02 
. 284E+03 
. 158E+01 
. 134E+01 


6 

• 423E+02 
. 103E+02 
.715E-01 
. 324E-01 


U 

.323E-01 
•431E-01 
. 303E-03 
. 139E-03, 


XV 

•211E+00 
. 2B2E+00 
. 198E-02 
. 907E-03 


9 

• 524E+02 
. 69BE+02 
•491E+00 
. 225E+00 


0 

• 724E+01 
. 966E+01 
• 60OE— 01 
• 31 IE-01 
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TABLE 3 


EIGENVALUE SENSIIVITY (S) AND STABILITY MARGIN 
MATRICES FOR LONGITUDINAL DYNAMICS 
OF A SMALL JET AIRCRAFT 

ANALYSIS PARAMETER: AIRSPEED V IN KNOTS 


A(p) =A 0 + Aip , p = {V - V 0 ) 
Nominal Flight Condition for A 0 



V 0 = 115 knots 

, 0=0. , Wt = 80, 000. lbs. , c.g. 0 = . 2 




X 0 = -.581 ± j 1.06 ; -.0125 ± j .174 



Ao 

A\ 

u 

-.352E-01 
-.2B6E+00 
-.332E-03 
. OOOE+OO 

w 

. 127E+00 
-.670E+00 
-.568E-02 
. OOOE+OO 

<7 

127E+02 
. 19BE+03 
— . 481E+00 
. 100E+01 

6 u w q 0 

-.321E+02 .573E-03 . 290E-02 -.690E+00 .331E-02 

— . 207E+01 . 755E-04 . 153E-01 -. 175E+01 111E+00 

— . 448E— 14 . 187E-04 .602E-04 . 416E-02 196E-15 

. OOOE+OO . OOOE+OO . OOOE+OO . OOOE+OO . OOOE+OO 



s 

Sensitivity 

U 

. 355E+00 
. 253E+00 
. 304E+02 
. 649E+02 

W 

. 101E+00 
. 359E+00 
.653E+02 
. 97BE+01 

q 

. 579E— 03 
. 1 92E-02 
. 349E+00 
.656E-01 

e 

. 204E-02 Sp = .996 E-2 

. 213E-02 
. 335E+00 
. 366E+00 

M p = 58.7 




M 

Stability Margin 

M u 


u 

.2S2E-01 
• 302E+01 
. 207E-0 1 
. 777E+00 

W 

. 176E+00 
. 1 1 5E+01 
. 31 BE— 01 
. 121 E— 01 

<7 

. 255E+02 
- 151E+03 
. 119E+01 
■ 620E+00 

e 

. 247E+02 
. 653E+01 
.545E-01 
■ 254E-01 

U 

• 250E—01 
• 350E-01 
. 292E-03 
. 137E-03 

w q 

. 173E+00 . 254E+02 
. 242E+00 . 356E+02 
. 202E-02 . 297E+00 
. 944E-03 . 139E+00 

e 

.443E+01 
. 622E+01 
.519E-01 
. 243E-01 
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